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To solve the optimization problems, the steps are performed in the following sequence. let's say f(x) let the 
function be twice differentiable. As we know, the minimum condition of such a function: 


f'(x") = 0 

and this is a necessary condition. x* - and for the point to be the minimum point: 
PQ) 0 

a condition is a sufficient condition. 


So, f'(x*) =0 we solve the equation numerically. We give the initial approximation of xk, and we 
approximate the solution ourselves. We expand the function at this point into a Taylor series. In this case, we 
limit ourselves to the second-order term, that is, we build a quadratic model of the function. 


fx) © F(X) = Fru) + fer) (% — Xx) 


If f(x,) # 0 if so, then f(x) has a single stationary point. To find this point f’(x) — we make the derivative 
equal to zero: 


f'(@) = 0; F'@) = (Fn) + FG — 1) 2." —m))) = 0 
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=> 04 f'(Hq) +54 2* fi) —m) = 0=> 


f' (xx) 
f'' (XK) 
have the following iterative formula: 


X= XR - find the solution to the minimum of x k+1 - we accept as approximation, as a result we 


f' x) 
Xe+1 = Xk Ge (*) 


This formula is the same used to solve the equation f(x)=0 


f (Xx) 


Xe+1 = Xk — F' (xx) 
It should be noted that it is similar to the formula of Newton's method, but differs from it. 
1) f'(@) =0 the equation can determine not only the minimum, but also the maximum point. 
2) f(x) the model function may differ greatly from the function f(x) being optimized 


That is why at every step to check that we are going to the minimum /f(x;+7)<f(xx) we need to check the 
condition. If this condition is met, then we will proceed to the next step. If f(xc+1)<f(xx) and f'(x)(« - 
Xx) <0 is, then f(x) must decrease from x; in the direction of x44; at the beginning of the function. 
Therefore, the next optimal point can be found by dividing the step in the opposite direction, for example: 
Xp 

as can be seen from the formula (*), f'(x,)(x — x,) the expression is negative if and only if f"(x,)>0. 
This means that if the local model used to derive the Newton step has a minimum (not a maximum), then the 
step is guaranteed to have an optimal direction. 


If on the other hand, if f'’(x) < Oand f'(x;,)(x — x,) >0, then f(x) increases initially when going from x; to 
Xx+1, SO the step should be done in the opposite direction. 


As acriterion for stopping iteration (convergence) in optimization. 


f (Xx) 
the condition can be accepted, € - pre-given precision. This method is called Newton or Newton-Raphson 
method. In some cases f(x) it is difficult to get derivatives of the function, in such cases Newton's method 
can be modified. For this, we choose initial approximation x, and step h. x;-h, x, x,+h let's look at the points. 
In that case f'(x;,) va f'"(x;,) derivatives can be replaced by approximate formulas as follows. 


f(x+h)-f(«) f(x+h)-f@-h) 
h 2h 


<€é 


f' (x) = lim or f(x) = lim 


lim dropping the symbols, we get the following approximate formulas 
' FORth)—f xR-h) 
f' x) * ——— 


flegth)-F(xK) fF (xK)-f(eKRH) 
nh nh 


Ff" Ge) i f' (xgth)—f' (xp—-h) = ay 


2h 2h 


" (eth)—2f XK) tf &K-N) 
f(y) » See eee 


In that case, if we put (*) in the above formula, we will get an iterative formula as a result: 


— fF ORtN)-FOR-N) eg, 
f Xeth)—-2f (Xp )+Ff (XR) 


This formula is called Quasi Newton or Newton's modified method. 


Xk+1 = Xk 


© 2023,CAJMTCS | CENTRAL ASIAN STUDIES www.centralasianstudies.org ISSN: 2660-5309 | 58 


CENTRAL ASIAN JOURNAL OF MATHEMATICAL THEORY AND COMPUTER SCIENCES _ Vol: 04 Issue: 01 | Jan 2023 


Let's look at the following examples: 


1) f@)=x*-2x -4 


xX, we look at the graph of the function to pick a point. As can be seen from the graph, the minimum point is 
close to the point x=1. That is 


x; =1 we choose that. Using the above formulas successively, we find the solution with the given 
accuracy. We use the Excel program to facilitate calculations: 


Be Rael ee 


-5,087962963 z 016600667 
— oe 0, ee anaes | 5 aaa 5, are = -5,088662037 | 0,000163785 
/x3| 0,816666667 | 0,000833333 -5,088662037 | >| -5,088662108 | 1,70515E-08 


Since we selected a point x,using the graph, the solution was found in the second step. x; the number of 
steps may increase when we choose a point arbitrarily. 


4 
2) Let's look at the graph of the following f(x) = x — In(x) + 4, We find the first and second derivatives 
of the function: 


, 1 a” 1 


Ej 


Using the graph, we select the point x;=0,7. x; since we chose a point very close to the exact solution, the 
solution was found in two steps with the given accuracy. 


Erase <eom 
Xk 


-0,05657 1429] 7,9208 16327 | 4,596774944 4,596573595 | 6,15052E-05 
| x» | 0,707142121 | 0,000282726 | 8,000399854 | 4,596573595 4,59657359 | 1,53706E-09 
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Newton's method used to solve optimization problems has the following disadvantages: 


1) The method requires a sufficiently good initial approximation, otherwise the number of steps will 
increase, that is, the selected point may have a large difference in the minimum of the function f(x) being 
optimized 

2) It requires the existence and analyticity of first and second order derivatives. 

3) In Newton's method, there is no obstacle that prevents the iterative method from going towards 
maximum or turning points instead of the required minimum point. Also, the possibility that the step x44. 
-xX, - 18 too large can be shown as a disadvantage. 
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